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(54) Optical device and method for selecting object of focus 



(57) A camera capable of automatically detecting a 
main object in a sensed image. A distance distribution 
generation unit discriminates a plurality of areas in the 
sensed image on the basis of a predetermined condi- 
tion, and a main object area determination unit automat- 
ically determines the main object area out of the 
discriminated areas. If the determined main object area 



is different from the area where an operator intends to 
focus on and the operator wishes to change the main 
object area, a new main object area is selected in 
accordance with an instruction inputted from a main 
object area changing unit. Then, the camera focuses on 
the selected main object area. 
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Description 

BACKGROUND OF THE INVENTION 

5 [0001 ] The present invention relates to an optical device, such as an automatic focusing camera and a monitor cam- 
era, having an automatic focusing function. 

[0002] Various techniques for measuring distances to objects which are in different directions using an optical device 
are Known. One of these techniques is disclosed in the Japanese Patent Publication No. 4-67607. Further, a plurality of 
techniques for estimating an area, in the object space, which includes a main object on the basis of distance distribution 
w information of the objects obtained by using the techniques for measuring distances to the objects are disclosed. 
[0003] Below, a typical conventional method of estimating an area which includes a main object is explained with ref- 
erence to Figs. 15A to 15C. 

[0004] First, a scene, such as the one shown in Fig. 15A, is sensed by using a pair of image sensing devices, such 
as CCDs, arranged inside of an optical device, such as a camera, at a predetermined distance from each other. Two 

is images, sensed by the pair of image sensing devices, which have parallax are respectively divided into Mxn blocks. 
Then, by performing known correlation operation between signals of a given block of one of the two images and signals 
of the corresponding block of the other image, it is possible to obtain the distance to an object and/or a defocused 
amount of the block based on trigonometry principle. The correlation operation is performed on every block, and dis- 
tance cfistrbution information of Mxn blocks as shown in Fig. 15B is obtained. The numerals in Fig. 15B denote dis- 

20 tance values or defocused values. The blank blocks are where it is determined that reliability of the result of correlation 
operation performed on these blocks is low due to low contrast of image signals, for instance. 
[0005] Next, grouping of blocks is performed in order to separate objects, in the object space, on the sensed images. 
After grouping, the M x n blocks are combined into areas each includes each object as shown in Fig. 15C. Note that the 
hatched portions in Fig. 15C correspond to the blank blocks in Fig. 15B and are determined that reliability of the result 

25 of correlation operation in these areas is low due to low contrast of image signals, for instanca 

[0006] As for a method of grouping, there is a method of determining similarity of adjoining blocks by, e.g., comparing 
the values of the adjoining blocks shown in Fig. 15B, and determining that the adjoining blocks are composed of the 
same object if the similarity is high, whereas, determining that they are composed of different objects if the similarity is 
low. Note, when the images are divided into relatively large blocks, as shown in Fig. 15B, the distance distribution infor- 

30 mation to be used for the grouping is simple values, such as distance values or defocused values; however, in a case 
where the block is very small, fine distance cfistrfcution information can be obtained, the information is often vectors nor- 
mal to surfaces. 

[0007] For example, a distance value of a given block as shown in Fig. 1 5B is compared to respective distance values 
of its adjoining blocks, and if the difference between the distance values of the adjoining two blocks is within a prede- 
35 termined threshold, then it is determined that the objects in the blocks compose the same object". Whereas, if the dis- 
tance is greater than the threshold, then it is determined that "the object in the blocks compose different objects." By 
performing the aforesaid determination on every block, blocks are grouped into common objects. The grouped blocks 
which compose each object are dealt with as a group 

[0008] Thereafter, characteristics of each group in the image are evaluated, and the group which includes the main 

40 object is determined out of all the groups. 

[0009] In a case of the groups as shown in Fig. 1 5C, characteristics, such as average distances to the objects, widths, 
heights, and positions of the groups in the frame, are obtained for all the groups GR1 to GR7, and evaluated as a whole, 
thereby determining the group which is considered to include the main object For example, likelihood (possibility) of the 
group having the main object is obtained using a predetermined function, such as the following equation 1, then the 

45 obtained values are evaluated. 

(possibility) = W1 x (width) x (height) + W2/(cfistance from the center of frame) + W3/(average distance) (1) 

[001 0] In the equation 1 , W1 , W2, and W3 are constants for weighting items, "distance from the center of frame" is 
so the distance between the center of the frame and the center of mass of the group, and "average distance" is an average 
of distances to the object from the camera in all the blocks of each group. The probability is calculated for every group, 
and the group having the largest probability is determined as including the main object. 

[001 1 ] Thereafter, a focal length is determined on the basis of the distance information of the group, determined as 
including the main object, so as to focus on an object in the group, then the lens is actually moved to focus on the object. 
55 [0012] In the conventional focusing function as descrbed above, an area including the main object is automatically 
determined on the basis of the aforesaid information, for instance, and focus control is performed on the basis of the 
determined result. 

[0013] However, there are a variety of scenes to be sensed and a variety of objects to be the main object; therefore. 
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the main object which the user actually intends to focus on is not always correctly determined as the main object in the 
aforesaid method. 

[0014] Furthermore, an increase in the distance measuring points and areas caused by an increase in the number 
pixels of the CCDs complicates the determination of main object, which increases difficulty to focus on the main object 
5 completely automatically. However, since full-manual-selection of selecting the main object also complicates operation 
of a camera, it is desirable to realize unification of automatic control and manual control to a high degree. 

SUMMARY OF THE INVENTION 

10 [001 5] The present invention has been made in consideration of the above situation, and has as its object to provide 
an optical device and method for selecting a distance measurement point capable of correctly selecting an object which 
an operator intends to focus on, and focusing on the selected object 

[001 6] According to the present invention, there is provided an optical device comprising: area cfiscrimination means 
for discriminating a plurality of areas in a sensed image on the basis of a predetermined condition; main object area 
75 determination means fa determining a main object area out of the plurality of areas discriminated by the area discrim- 
ination means; main object area changing means for changing the main object area to another area; and focus control 
means for focusing on the main object area. 

[001 7] A second aspect of the present invention provides an distance measuring point selection method comprising: 
an area discrimination step of discriminating a plurality of areas in a sensed image on the basis of a predetermined con- 

20 dition; a main object area determination step of determining a main object area out of the plurality of areas discrimi- 
nated in the area discrimination step; a main object area changing step of changing the main object area to another 
area; a change instruction detection means of detecting whether or not there is any instruction to change the main 
object area; a control step of controlling to disable the main object area changing step when it is determined that there 
is no instruction to change the main object area in the change designation determination step; and a focus control step 

25 of focusing on the main object area. 

[0018] Other features and advantages of the present invention will be apparent from the following description taken 
in conjunction with the accompanying drawings, in which like reference characters designate the same or similar parts 
throughout the figures thereof. 

30 BRIEF DESCRIPTION OF THE DRAWINGS 

[0019] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate 
embodiments of the invention and, together with the description, serve to explain the principles of the invention. 

35 Fig. 1 is a block cfiagram illustrating a basic configuration of a camera according to a first embodiment of the present 
invention; 

Fig. 2 shows an optical arrangement of basic optical elements of the camera according to the first embodiment of 
the present invention; 

Fig. 3 is a perspective view showing an arrangement of the optical elements of the camera according to the first 
40 embodiment of the present invention; 

Fig. 4 is a top view showing the arrangement of the optical elements of the camera according to the first embodi- 
ment of the present invention; 

Fig. 5 is a diagram illustrating an internal configuration of the camera; 

Fig. 6 is a flowchart showing a basic operation according to the first embodiment of the present invention; 
45 Fig. 7 is a flowchart of distance distribution generation processing according to the first embodiment of the present 
invention; 

Fig. 8 is a flowchart of main object area detection processing according to the first embodiment of the present 
invention; 

Fig. 9 is a flowchart of focal length determination processing according to the first embodiment of the present inven- 
50 tion; 

Fig. 10 is a flowchart of main object area selection processing according to the first embodiment of the present 
invention; 

Fig. 1 1 is an explanatory view of a method for dividing an image into a plurality of areas; 
Fig. 12A shows an example of an image sensed by the camera; 
55 Fig. 12B shows a result of labeling of the image shown in Fig. 12A; 

Fig. 13 is a block diagram illustrating a basic configuration of a camera according to a second embodiment of the 
present invention; 

Fig. 1 4 is a flowchart of main object area selection processing according to the second embodiment of the present 



3 



EP 0 926 526 A2 



invention; and 

Figs. 15A to 15C are explanatory views for explaining the conventional distance measuring operation. 
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

5 

[0020] Preferred embodiment of the present invention will be described in detail in accordance with the accompanying 
drawings. 

(First Embodiment) 

10 

[0021 ] Taking a function of selecting a distance measurement point of an automatic focusing camera as an example, 
a system capable of arbitrary changing a main object area from an area, obtained as a result of automatic main object 
area selection, to another area using a single axis rotary operation member (dial) is explained. 
[0022] Fig. 1 is a block diagram showing basic elements of a camera according to the first embodiment of the present 

is invention. In Fig. 1 , reference numeral 51 denotes a distance distribution generation unit for measuring the distance to 
an arbitrary point in the object space; 52, a main object area determination unit for determining an area which most 
probably includes the main object (referred to as "main object area" hereinafter) in the sensed image; 53, a main object 
area changing unit for changing the main object area, determined automatically, to another area in response to a man- 
ual input; 54, a focal length determination unit for determining a control value to control the focus point of an optical sys- 

20 tern 55 on the basis of information on the determined main object area; 55, the optical system for sensing an image; 
and 56, a lens driver for driving the lens to focus. A dot line 57 is for indicating units which are realized by a CPU, RAM 
and ROM of a computer. Since the distance distribution generation unit 51 is realized with the computer and an optical 
system for distance measurement, and the main object area changing unit 53 is realized with the computer and an 
operation member, these units are shown on the dot line 57. 

25 [0023] A configuration of an optical system used for generating distance distribution information is explained below. 
[0024] Rg. 2 shows an optical arrangement of optical elements, of the camera, for measuring the distance to a point 
in the object space. In Rg. 2, reference numeral 1 denotes an image sensing lens; 8. a field lens; 9, secondary focusing 
lenses; and 10, an area sensor. Fluxes, introduced by the image sensing lens 1 through different positions, incident on 
two image forming areas 1 0a and 1 0b of the area sensor 1 0 in the magnification determined by the powers of the field 

30 lens 8 and the secondary focusing lenses 9. The area sensor 10 is arranged on a conjugate plane of a film to be 
exposed with respect to the image sensing lens 1 , and all or a part of an image to be sensed is formed on each of the 
image forming areas 1 0a and 1 0b. 

[0025] Rg. 3 is a perspective view showing an arrangement of the optical system for measuring the distance, shown 
in Rg. 2, when it is applied to the camera Referring to Rg. 3, reference numeral 6 denotes a quick return mirror; 18, a 
35 pentaprism; 19, a light-splitting prism; and 20, a full-reflection mirror. Other reference numerals in Rg. 3 are same as 
those explained with reference to Rg. 2. 

[0026] Rg. 4 is atop view when the arrangement shown in Rg. 3 is overlooked from above. 
[0027] Using an optical system as descnbed above, two images having predetermined parallax are obtained. 
[0028] Note, a camera having the aforesaid configuration is disclosed in detail in the Japanese Patent Application 
40 Laid-Open No. 7-134238. 

[0029] Rg. 5 is a circuit diagram illustrating a configuration of the camera having the aforesaid optical system. Rrst, 
each unit is explained. 

[0030] In Rg. 5, PRS denotes a camera controller, which may be a one^hip microcomputer having a CPU, ROM. 
RAM, and analog-digital converter. The camera controller PRS performs a series of operations of the camera, such as 
45 automatic exposure control, automatic focus control, and advancing and rewinding of a film, on the basis of sequence 
program stored in the ROM. Thus, the camera controller PRS communicates with inside circuits of the camera and a 
lens control unit using communication signals SO and SI. a synchronizing clock SCLK, and communication selection 
signals CLCM, CDDR and CICC, to control operation of each circuit and lens. 

[0031] Regarding communication signals. SO is a data signal outputted from the camera controller PRS, SI is a data 
so signal inputted to the camera controller PRS, and SCLK is a synchronizing dock for signals SO and SI. 

[0032] Further, in Fig. 5. reference LCM denotes a lens communication buffer circuit and it siftplies electric power to 
a power input terminal VL for the lens when the camera is under operation, further, when the selection signal CLCM 
from the camera controller PRS is in high potential level (referred as "H", and low potential level is referred as "L". here- 
inafter), it acts as a communication buffer between the camera controller PRS and the lens. 
55 [0033] When the camera controller PRS controls the selection signal CLCM to be "H" and outputs predetermined 
data, such as the data signal SO, in synchronization with the synchronizing clock SCLK, the lens communication buffer 
circuit LCM outputs buffer signals LCK and DCL corresponding to the synchronizing clock SCLK and the data signal 
LO, respectively, to the lens via a communication node between the camera controller PRS and the lens. At the same 
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time, a buffer signal of the signal DLC is outputted from a lens unit LNS as the data signal SI, and the camera controller 
PRS receives data of the lens as the data signal SI in synchronization with the synchronizing clock SCLK. 
[0034] Reference DDR denotes a circuit for detecting operation of various switches SWS and for display. It is selected 
when the signal CDDR is "H", and controlled by the camera controller PRS by using the data signals SO and SI, and 
5 the synchronizing clock SCLK. More specifically, the circuit DDR changes the displayed contents on a display member 
DSP of the camera on the basis of data sent from the camera controller PRS, and notifies the camera controller PRS 
of the ON/OFF state of each of the operation switches SWS of the camera. The state of the rotary operation member 
of the main object area changing unit 53 is also detected by the circuit DDR. 

[0035] Reference OLC denotes an outside liquid crystal display provided in the upper portion of the camera, and ret- 

10 erence ILC denotes a liquid crystal display inside of a finder. 

[0036] Switches SW1 and SW2 are coupled with a shutter release button (not shown), and with a half press of the 
shutter release button, the switch SW1 is turned on, and with a full press of the shutter release button, the switch SW2 
is turned on. The camera controller PRS performs photometry and automatic focus adjustment in response to the "on" 
operation of the switch SW1 , and in response to the "on" operation of the switch SW2, it controls exposure, thereafter, 

15 advances the film one frama 

[0037] Note, the switch SW2 is connected to an interruption input terminal of the camera controller PRS, and even 
when programs triggered by the "on" operation of the switch SW1 is under execution, the "on" operation of the switch 
SW2 interrupts the execution, and the camera controller PRS swiftly moves to a predetermined interrupt program. 
[0038] Reference MTR1 denotes a motor for advancing the film, and reference MTR2 denotes a motor for moving a 

20 mirror in the up and down direction and charging of a shutter spring, and the f am and the mirror are controlled to move 
in the forward and reverse directions by the motors MDR1 band MDR2, respectively. Signals M1F, M1 R, M2F and M2R, 
inputted from the camera controller PRS to driving circuits MDR1 and MDR2, are forward and reverse rotation control 
signals. 

[0039] References MG1 and MG2 denote front and rear curtain operation magnets, which are supplied with electric 
25 power via amplifying transistors TR1 and TR2 in response to control signals SMG1 and SMG2, and the shutter is con- 
trolled by the camera controller PRS. Note, the motor driving circuits MDR1 and MDR2 and shutter control are not 
directly related to the present invention, therefore, detailed explanation of them are omitted. 

[0040] A buffer signal DCL which is inputted to the lens controller LPRS in synchronization with the buffer signal LCK 
is instruction data from the camera controller PRS to the lens unit LNS, and operation of the lens unit LNS correspond- 

30 ing to each instruction is predetermined. The lens controller LPRS analyzes the instruction in a predetermined proce- 
dure, and outputs operation states of focusing control, iris diaphragm control, the output signal DLC, each element of 
the lens unit LNS (e.g., operation states of focusing control optical system and operation states of iris diaphragm), and 
various parameters (open f-number, focus distance, coefficient of amount of movement of focusing control optical sys- 
tem corresponding to defocus amount, various focus correction amounts, etc.) 

35 [0041 ] A zoom lens is explained in the first embodiment as an example, and when an instruction for focus adjustment 
is transmitted from the camera controller PRS, a motor LMTR for focus adjustment is operated on the basis of the sig- 
nals LMF and LMR showing an amount and direction of displacement which are transmitted simultaneously. Accord- 
ingly, focus adjustment is performed by either rotating the optical system in the forward or reverse direction along the 
optical axis. The amount of displacement of the optical system is obtained in the following manner. First, a pattern of a 

40 pulse board, which rotates, coupled with the optical system, is detected by a photocoupler, monitoring a pulse signal 
SENCF outputted from an encoder ENCF which outputs pulses whose number corresponds to the displacement 
amount The number of the pulses SENCF is counted by a counter (not shown) provided inside of the lens controller 
LPRS. When the optical system finishes moving by a calculated amount, then the lens controller LPRS controls the sig- 
nals LMF and LMR to n L" to operate the motor LMTR. 

45 [0042] Therefore, after an instruction for focus adjustment is transmitted from the camera controller PRS, the camera 
controller PRS does not care about operation of the lens until the lens finishes displacement Further, the lens controller 
LPRS transmits the value of the counter to the camera controller PRS when the camera controller PRS requests to do 
so. 

[0043] When an instruction for controlling the iris diaphragm is transmitted from the camera controller PRS, a stepping 
so motor DMTR, which is known for driving an iris diaphragm, is operated based on an iris diaphragm stage number trans- 
mitted at the same time. Note, since the stepping motor DMTR can control the opening of the iris diaphragm, an 
encoder for monitoring the operation is not necessary. 

[0044] Reference ENCZ denotes an encoder attached to a zoom optical system, and the lens controller LPRS detects 
the zoom position by receiving a signal SENCZ from the encoder ENCZ. The lens controller LPRS stores lens param- 
55 eters corresponding to respective zoom positions, and outputs a parameter corresponding to a current zoom position 
to the camera controller PRS when the camera controller PRS requests to do so. 

[0045] Reference ICC denotes an area sensor unit including area sensors, such as CCDs, and an operation circuit 
for operating the area sensors, which is used for focus state detection and photometry. The area sensor unit ICC is 



5 



EP 0 926 526 A2 



selected when the selection signal CICC is "H", and controlled by the camera controller PRS using the data signals SO 
and SI, and the synchronizing clock SCLK. 

[0046] 4»V and <J>H are read signals for the area sensors, and <t>R is a reset signal. These sensor signals are generated 
by a driving circuit provided inside of the area sensor unit ICC on the basis of signals from the microcomputer PRS. The 
5 signals outputted from the area sensors are amplified, then inputted into an analog signal input terminal of the micro- 
computer PRS as output signals IMAGE. Thereafter, the microcomputer PRS converts the analog output signals 
IMAGE into digital signals, and the values of the digital signals are sequentially stored in the RAM at predetermined 
addresses. With these digitized signals, to generate distance distribution information in the object space, focus control, 
or photometry is performed. 

io [0047] Reference DL denotes a rotary operation member, which is used for indicating the direction to change the main 
object area, which will be explained later. Further, reference DLS denotes a sensor for detecting the rotated direction of 
the rotary operation member DL, which outputs a signal RTDR indicating the detected direction to the camera controller 
PRS. 

[0048] Note that the camera body and the lens are described detachable (i.e., lenses are exchangeable) in Fig. 5; 
is however, the present invention is not limited to the camera of this type. For example, it is possible to apply the present 
invention to a camera whose camera body and lens are integrally composed. 

[0049] Below, a detailed operation and overall flow of the operation of the camera having the aforesaid configuration 
are explained with reference to Figs. 6 to 1 2. 

[0050] First referring to Fig. 6, an image sensing operation starts in step S100 when an operator presses a shutter 
20 release button (not shown), for instance. 

[0051] Next in step S101 , a sub-routine for generating distance distrtoution information (distance distribution genera- 
tion processing) in the object space is called by the distance distribution generation unit 51 . 
[0052] Fig. 7 is a flowchart showing the distance distrfoution generation processing. 

[0053] In step S201 in Fig. 7, images are read from the area sensors. The image are read in the following manner. 

25 First the area sensors are reset. More specifically, by controlling the control signals <j>V, <j>H and $R to be "H" simultane- 
ously for a predetermined period, residual charges are drained and the area sensor is reset 
[0054] Next, the camera controller PRS transmits an instruction to start charging, and accumulation of charges starts 
in response to the instruction. After a predetermined period elapses, the accumulation of charges ends. 
[0055] Thereafter, the control signals <t>V and 4>H are controlled to drive the area sensors to sequentially output image 

30 signals IMAGE, which are A/D converted and stored in RAM in the camera controller PRS. Accordingly, image reading 
operation in step S201 is completed. 

[0056] The output image signals from the two area sensors are stored as IMG1 and IMG2 in a predetermined area 
of the RAM. 

[0057] Next each of the images IMG1 and IMG2 obtained from the two area sensors is divided into M x n blocks and 

35 defocus distribution (defocus map) is generated in step S202 and its subsequent steps. 

[0058] First in step S202, variables x and y, which are for indicating a block, are initialized. Next in step S203, lumi- 
nance signals necessary for performing cfistance measuring operation for a block B(x, y), i.e., luminance signals of the 
block obtained from one of the area sensors, are extracted from the image data IMG1 stored in the RAM, and copied in 
the RAM at predetermined addresses A. 

40 [0059] In step S204, luminance signals necessary for performing distance measuring operation for the block B(x, y) 
are extracted from the image data IMG2, and copied in the RAM at predetermined addresses B. 
[0060] In step S205, a known correlation operation COR(x, y) is performed on the luminance signals (luminance dis- 
tribution signals) recorded at the addresses A and B, and a phase difference between the two luminance distributions 
is calculated. 

45 [0061 ] Thereafter, in step S206, a distance value or a defocused amount is obtained using any known function F() on 

the basis of the phase difference between luminance cfistrfoutions calculated in step S205, and stored in the RAM at an 

address D(x, y) which is reserved for recording distance distribution information. 

[0062] In step S207, the variable x is increased by 1 to move a block to be processed to the next block. 

[0063] In step S208, x and the division number M in the x direction are compared, and if it is determined in step S208 
so that x is less than M, then the process returns to step S203, and a distance value or a defocused amount of the next 

block in the x direction is calculated and stored. If it is determined in step S208 that x is equal to or greater than M, then 

the process moves to step S209, where x is initialized to 0 and y is increased by 1 . 

[0064] In step S21 0, y and the division number n in the y direction are compared, and if it is determined that y is less 
than n, then the process returns to step S203 and the operation for the next row starts. Whereas, rf it is determined that 
55 y is equal to or greater than n, then the process proceeds to step S21 1 , where operation for obtaining a cfistance value 
or a defocused amount of every block has been completed. Accordingly, the distance distribution generation sub-rou- 
tine of step S101 in Fig. 6 is completed. 

[0065] Next in step S1 02, a sub-routine tor detecting a main object area (main object area detection processing) is 
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called by the main object area determination unit 52. The contents of the main object area detection sub-routine are 
explained with reference to Fig. 8. 

[0066] In step S301 in Fig. 8. operation for numbering respective objects (groups), configuring the object space, is 
performed. 

5 [0067] In a case of numbering (grouping) the blocks while performing raster scanning in the direction of an arrow from 
the left-uppermost block in Fig. 1 1 , for instance, a determination whether or not a block of interest B(x, y) and its upper 
block B(x, y-1) belong to the same group and a determination whether or not the block of interest B(x, y) and its left 
block B(x-1 , y) belong to the same group are performed. Eventually, determination whether or not a given block and its 
adjoining blocks belong to the same block is performed on every block. In this case, blocks in the uppermost row (y=0) 

w and the leftmost column (x=0) does not have upper blocks and left blocks, respectively; therefore, determination 
between the blocks in the uppermost row and their upper blocks, and between the left most column and their left blocks 
are not performed. 

[0068] Further, the results of determination are stored in the RAM at reserved addresses Q(0, 0) to G(M-1 , n-1 ). First, 
the block B(x, y) = B(0, 0) is registered with a group number g = 1 . Whenever a new group which composes another 
is object is detected, the group number is increased by 1 and the increased number becomes the group number of the 
new group. With this operation, respective blocks of the sensed image as shown in Fig. 1 2A are labeled group numbers 
for respective groups as shown in Fig. 12B. 

[0069] The numbering processing as described above is a known technique called "labeling method", and a flowchart 
of grouping of the blocks is omitted. Further determination method of determining whether or not two blocks belong to 
20 an identical group is disclosed in the Japanese Patent Laid-Open Application No. 10-161013; accordingly, detailed 
explanation of the method is omitted. 

[0070] The number of groups detected in step S301 is set to a variable Gnum in step S302. 
[0071 ] In step S303 and its subsequent steps, characteristics of each group forming the sensed image are evaluated, 
and a group which most probably includes a main object (main object area) is determined out of all the groups (object 
25 areas) on the basis of the evaluated characteristics. First in step S303, a variable Gcur which denotes a group to be 
processed is set to 1. 

[0072] In step S304, a likelihood (probability), S(Gcur), of a block or blocks, forming a group Gcur, of including a main 
object is calculated. The probability S(Gcur) is determined on the basis of an average distance to an object included in 
the group, width and height of the group, and the location of the group in the image. A group which is considered to 
30 include the main object is determined on the basis of the calculated probabilities of all the groups. As for a function of 
calculating the possbility S(Gcur), the equation 1, described above, may be used. 

[0073] In step S305, the value of Gcur is increased by 1 , and the group subjected to the operation is proceeded to the 
next group. 

[0074] In step S306, Gcur and Gnum are compared to check whether or not the operation has been performed on all 
35 the groups. If Gcur is equal to or less than Gnum, then all the groups have not been processed; therefore, the process 
returns to step S304. whereas, if Gcur is greater then Gnum, then the process proceeds to step S307. 
[0075] In step S307, using a function MAX, a group number having the maximum probability among the probabilities 
S(1) to S(Gnum) is found, and the group number having the greatest probability substitutes a variable Gmain. The 
blocks labeled the same group number as Gmain are determined as forming the main object area. 
40 [0076] In step S308. the main object area detection processing is completed; thus step S1 02 in Fig. 6 is finished. 
[0077] Thereafter, the process proceeds to step S103 in Fig. 6, where a process of determining a focal length (focal 
length determination processing) is performed by the focal length determination unit 54. Here, a sub-routine for deter- 
mining a focal length on the basis of information on the main object area is executed. The focal length determination 
processing is explained with reference to Fig. 9. 
45 [0078] In step S401 in Fig. 9, an area, in the object space, subjected to the focal length determination processing is 
set to the main object area on the basis of the group number detected in step S1 02. 

[0079] In the subsequent step S402, distance information for focus adjustment is calculated on the basis of informa- 
tion on the main object area set in step S102. Here, an algorithm which gives priority to the minimum distance in the 
object area is used, and the minimum cfistance to the object in the area is calculated. 

so [0080] Thereafter, in step S403, the minimum distance is set as the distance to an object to be focused on; thereby 
the focal length determination processing is completed, and the process returns to the flowchart in Fig. 6. 
[0081] After the operation of steps S101 to S103, performed in the camera controller PRS, an instruction to control 
focus is transmitted to the lens from the camera controller PRS so as to focus on a point at the distance determined in 
step S103, and the lens controller LPRS controls the motor LMTR to focus on the object which is currently considered 

55 as the main object in step S104. 

[0082] Next in step S1 05, whether or not the current focus state is proper, namely, whether the main object area which 
is currently selected includes the main object which the operator intends to focus on, is determined. In the first embod- 
iment, whether or not the operator wishes to change the main object area is checked by detecting a state of the rotary 
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operation member of the main object area changing unit 53 or a state of the switch SW2 of the shutter release button 
which trigger image sensing operation. More specifically, if the rotary operation member of the main object area chang- 
ing unit 53 is operated before the switch SW2 of the shutter release button is turned on, then it is determined that the 
operator wishes to change the main object area, whereas, if the switch SW2 is turned on before detecting any operation 
5 of the rotary operation member, then it is determined that the operator is satisfied with the main object which is currently 
set 

[0083] First, in a case of leaving the main object area unchanged, control signals SMG1 and SMG2 to the respective 
front and rear curtain operation magnets MG1 and MG2 are generated at proper intervals by the camera controller PRS 
in step S107. the film is exposed, and the image sensing operation is completed. 
10 [0084] Whereas, if a change in main object area is requested in step S105, then the process proceeds to step S106. 
where the process of selecting a main object area is performed. 
[0085] The main object area selection process is explained with reference to Fig. 1 0. 

[0086] When a change in main object area is requested in step S1 05 as described above, namely, when the rotary 
operation member is operated, the direction of the rotation is detected in step S501 . In the first embocfiment, a system 

is of inputting a moving direction in the object space from the currently selected main object area to an object area which 
the operator desires using the single axis rotary operation member DL (dial). When rotation to the left is detected, the 
process proceeds to step S502, whereas when rotation to the right is detected, the process proceeds to step S503. 
[0087] In step S502 or S503, on the bass of the rotational direction detected in step S501 , an object area on the left 
or right of the area which is currently selected as the main object area is set as a new main object area; accordingly, 

20 the main object area selection process is completed. 

[0088] After the selection of main object area by manual operation is performed in step S1 06 as described above, the 
process returns to step S103, where a focal length is determined on the basis of information on the current main object 
area. Further, the lens is moved in step S1 04, and whether or not the current main object area is to be changed is deter- 
mined in step S105, and depending upon the determined result, either exposure operation in step S1 06 or the main 

25 object area selection processing in step S107 is performed. 

[0089] The operation of changing the main object area performed in step S501 and its subsequent steps is explained 
taking a scene in Fig. 12A as an example. If an object area of group number 3 in Fig. 12B is originally selected as the 
mains object area, and if rotation of the dial to the right is detected in step S501 , then an object area of group number 
4 is selected as the new main object area, and lens is controlled to focus on an object in the new main object area of 

30 group number 4. ff rotation of the dial to the right is detected again in step S501 , then an object area of group number 
6 is selected and set as the new main object area. 

[0090] In older to show which object area is currently selected as the main object area, an area selected as the main 
object area, namely, blocks having the identical group number, is surrounded by a line on a screen of a viewfinder. Alter- 
natively, a mark may be displayed at a rough center of the main object area. 
35 [0091 ] When the object which the operator intends to is focused, by pushing the release shutter button until the switch 
SW2 is turned on, image sensing operation is realized as desired. 

[0092] In the first embodiment as described above, only one single axis rotary operation member is used as an input 
member. However, the present invention is not limited to this, and two single axis rotary operation members whose rota- 
tion axes are orthogonal to each other may be used. In this case, four directions of rotation (i.e., up, down, left and right) 
40 may be detected. A slide-type direction designation member may be used instead of the rotary operation member. Fur- 
ther, an operation member, such as a track ball, capable of freely rotating in any direction may be used. In this case, 
operability of the camera would be improved. 

[0093] Further, instead of designating the location of the main object area by an operation member, a priority order 
may be determined on the basis of the probabilities S(1) to S(Gnum), which are results of evaluation functions, by sort- 
45 ing the probabilities, and the main object area may be changed from an object area having a higher probability to an 
object area having a lower probability. In a case where only one single axis rotary operation member is provided to the 
camera, a system of better operability may be realized by changing the main object area in accordance with a priority 
order. 

so (Second Embodiment ) 

[0094] Next, a case where the operation member is a focusing system of an optical device, such as a camera, is 
explained as the second embodiment 

[0095] In the second embodiment, so called a full-time manual type camera, whose automatic focusing system can 
55 be also operated manually is considered. A basic structure of the camera is the same as that explained in the first 
embodiment; therefore, configuration elements which are important for explaining the second embodiment-are mainly 
described. 

[0096] Fig. 13 is a block cfiagram showing basic configuration elements of the camera according to the second 
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embodiment of the present invention. In Rg. 1 3, reference numerals 51 , 52, 54 and 55 refer to the same elements 51 , 
52, 54 and 55 shown in Rg. 1 . A main object area changing unit 63 is within a dotted line 67 which represents an area 
realized by a CPU, RAM and ROM of a computer, and a signal line from the lens driver 66 to the main object area 
changing unit 63 is added (for notifying the moving direction of focal cf stance control member), since the function of the 
operation member in the main object area changing unit 53 is moved to the lens driver 66. 

[0097] Note, by configuring the system so that the signal flows from the lens controller 66 to the main object area 
changing unit 63 via the focal length determination unit 54, it is possible to simplify the configuration of the system. 
[0098] Rg. 14 is a flowchart of a main object area selection processing according to the second embodiment of the 
present invention. 

[0099] In the processing shown in Rg. 14, different from the processing shown in Rg. 10, the moving direction of the 
focusing system (rotation to the right and left when a normal rotation type focusing system is adopted) is determined in 
step S601 , and depending upon the moving direction of either forward (in the approaching direction to the camera) or 
backward On the receding direction from the camera), the main object area is changed to an object area which includes 
an object at a shorter distance in step S603 or an object area which includes an object at a longer distance in step 
S602. 1 
[01 00] More specifically, when the operator wishes to focus on an object which is at a shorter distance or at a longer 
distance than the distance where the currently focused object exists, the operator operates the focusing system in the 
desired direction, and the main object area is automatically changed to an object area which is in the direction the oper- 
ator desires. 

[01 01 ] The operation of changing the main object area is explained taking a scene in Rg. 1 2A as an example, similarly 
to the first embodiment. If an object area of group number 3 in Rg. 12B is originally selected as the main object area, 
and if rotation of the focusing system in the direction to focus on an object at a longer cfistance is detected in step S601, 
then an object area which includes an object existing at a longer cfistance than the area of group number 3 is deter- 
mined as the main object area on the basis of the distance value or the defocused amount detected in step S1 01 of Rg. 
6. In this case, an object area labeled group number 4 is set as the new main object area, the focusing system is con- 
trolled so as to focus on the object in the new main object area. If the similar rotation of the focusing system is detected 
again in step S601 , then an object area which includes an object existing at a longer distance than the area of group 
number 4, in this case an object area of group number 6, is selected and set as the new main object area. 
[0102] According to the first and second embodiments of the present invention as described above, a main object 
area which is automatically determined is checked by an operator, and if the determined area is not the area where the 
operator intends to focus on, it is possible for the operator to change the main object area to an arbitrary area by oper- 
ating a predetermined operation member. 

[0103] Accorcfingfy, a camera capable of performing focus control while reflecting intention of the operator with easy 
operation is realized. 

[01 04] The present invention is not limited to the above embodiments and various changes and modif ications can be 
made within the spirit and scope of the present invention. Therefore to appraise the public of the scope of the present 
invention, the following claims are made. 

Claims 

1. An optical device having: 

area discrimination means (51) for discriminating a plurality of areas in a sensed image on the basis of a pre- 
determined condition; and 

main object area determination means (52) for determining a main object area out of the plurality of areas dis- 
criminated by said area discrimination means, 
characterized by comprising: 

main object area changing means (53, 63, 66, DL) for changing the main object area to another area; and 
focus control means (54) for focusing on the main object area. 

2. The optical device according to claim 1 , wherein said main object area changing means (53, DL) has direction des- 
ignation means for designating a direction which is perpendicular to an optical axis of the optical device, and deter- 
mines an area next to the main object area in the cfirection designated by said direction designation means as a 
new main object area. 

3. The optical device according to claim 2, wherein said direction designation means is a rotary operation member 
(DL) capable of rotating at least in two directions. 
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4. The optical device according to claim 3, wherein said direction designation means is configured with a plurality of 
said rotary operation members (DL). 

5. The optical device according to claim 2 wherein said direction designation means is a slide-type designation mem- 
ber capable of designating at least two directions. 

6. The optical device according to claim 5, wherein said direction designation means is configured with a plurality of 
said slide-type designation members. 

7. The optical device according to claim 2, wherein said direction designation means is a track ball. 

a The optical device according to claim 2. wherein said direction designation member is operated in manual. 

9. The optical device according to claim 1 , wherein said area discrimination means (51) discriminates the plurality of 
areas in the sensed image on the basis of distances to objects included in the sensed image, and said main object 
area changing means (63, 66) has direction designation means for designating a direction along an optical axis of 
the optical device, and determines an area including an object a distance to which is next shorter or longer than a 
distance to an object included in the main object area as a new main object area depending upon the direction des- 
ignated by said direction designation means. 

10. The optical device according to claim 9, wherein said direction designation means (63, 66) is a focusing member 
of an image sensing optical system. 

1 1 . The optical device according to claim 10, wherein said direction designation member (63, 66) is operated in man- 
ual. 

12. The optical device according to claim 1, further comprising evaluation means (52) for calculating an evaluation 
value by performing a predetermined operation for each of the plurality of areas discriminated by said area discrim- 
ination means (51), wherein said main object area determination means (52) determines the main object area on 
the basis of the evaluation value calculated for each of the plurality of areas by said evaluation value calculation 
means. 

13. The optical device accorcfing to claim 1, wherein said main object area determination means (52) automatically 
determines the main object area. 

1 4. The optical device accorcfing to claim 1 , further comprising priority order determination means for determining a pri- 
ority order, and when a change in main object area is requested, main object area changing means (53) changes 
the main object area in the descending order of the priority. 

15. The optical device according to claim 14, further comprising evaluation means (52) for calculating an evaluation 
value by performing a predetermined operation for each of the plurality of areas discriminated by said area discrim- 
ination means (51), wherein said priority order determination means determines the priority order on the basis of 
the evaluation value calculated for each of the plurality of areas by said evaluation value calculation means. 

16. An distance measuring point selection method having: 

an area discrimination step (Fig. 7, S300-S303) of discriminating a plurality of areas in a sensed image on the 
basis of a predetermined condition; and 

a main object area determination step (S307) of determining a main object area out of the plurality of areas 
discriminated in said area discrimination step, 
characterized by comprising: 

a main object area changing step (S106) of changing the main object area to another area; 

a change instruction detection means (S1 05) of detecting whether or not there is any instruction to change the 

main object area; 

a control step (S105) of controlling to cfisable said main object area changing step when it is determined that 
there is no instruction to change the main object area in said change designation determination step; and 
a focus control step (S1 03) of focusing on the main object area. 
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17. The distance measuring point selection method according to claim 16, wherein, in said main object area changing 
step (S1 06), an area next to the main object area in the direction designated from outside is selected as a new main 
object area. 

5 18. The cfistance measuring point selection method according to claim 17, wherein the direction designated from out- 
side is selected from at least two directions. 

19. The distance measuring point selection method according to claim 18, wherein the direction designated from out- 
side is perpendicular to an optical axis. 

10 

20. The distance measuring point selection method according to claim 16, wherein, in said area discrimination step 
(Fig. 7, S300-S303), the plurality of areas in the sensed image are discriminated on the basis of distances to 
objects included in the sensed image, and, in said main object area changing step (S106), an area including an 
object a cfistance to which is next shorter or longer than a distance to an object included in the main object area is 

is selected as a new main object area depending upon a direction designated from outside. 

21. The cfistance measuring point selection method according to claim 20, wherein the direction designated from out- 
side is an optical direction. 

20 22. The distance measuring point selection method accord ng to claim 16, further comprising an evaluation step 
(S304-S306) of calculating an evaluation value by performing a predetermined operation for each of the plurality of 
areas discriminated in said area discrimination step (Fig. 7, S300-S303), wherein, in said main object area deter- 
mination step (S307), the main object area is determined on the basis of the evaluation value calculated for each 
of the plurality of areas in said evaluation value calculation step. 

25 

23. The distance measuring point selection method according to claim 16, wherein, in said main object area determi- 
nation step (S307), the main object area is automatically determined. 

24. The distance measuring point selection method according to claim 16, wherein, the instruction to change the main 
30 object area detected in said change instruction detection means (S105) is designated manually. 

25. The distance measuring point selection method according to claim 16, further comprising a priority order determi- 
nation step of determining a priority order, and when a change in main object area is requested, in said main object 
area changing step (S106), the main object area is changed in the descending order of the priority. 

35 

26. The distance measuring point selection method accorcfing to claim 25, further comprising an evaluation step 
(S304-S306) of calculating an evaluation value by performing a predetermined operation for each of the plurality of 
areas discriminated in said area discrimination step (Fig. 7, S300-S303), wherein said priority order determination 
step, the priority order is determined on the basis of the evaluation value calculated for each of the plurality of areas 

40 in said evaluation value calculation step. 

27. A camera comprising means for determining a main object from a sensed image, focussing means capable of auto- 
matically focussing the camera on the main object, and means for shifting said main object to a second object and 
causing said focussing means to focus on the second object 

45 
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FIG. 6 
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FIG. 9 
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FIG. 12B 
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FIG. 14 
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